On information flow and feedback in relay networks 



Bobbie Chern, Ayfer Ozgiir 

Stanford University 

Stanford, California 94305 

{bgchern, aozgur}@ stanford.edu 



o- 

Oh- 






> 

m 

o 
en 



X 



Abstract — We consider wireless relay networks where a source 
node communicates to a destination node with the help of 
multiple intermediate relay nodes. In wireless, if a node can 
send information to another node, typically it can also receive 
information from that node. Therefore, there are inherently a lot 
of opportunities for feeding back information in such networks. 
However, transmissions are not isolated and usually subject to 
broadcast and interference. 

In this paper, we ask the following question: Can the informa- 
tion transfer in both directions of a link be critical to maximizing 
the end-to-end communication rate in such networks? Equiva- 
lently, could one of the directions in each bidirected link (and 
more generally at least one of the links forming a cycle) be shut 
down and the capacity of the network still be approximately 
maintained? Our main result is to show that in any arbitrary 
Gaussian relay network with bidirected edges and cycles, we can 
always identify a directed acyclic subnetwork that approximately 
maintains the capacity of the original network. The edges of this 
subnetwork can be identified as the information carrying links, 
and the remaining links as feedback, which can only provide 
limited contribution to capacity. 

I. Introduction 

Feedback has been studied extensively for single-hop com- 
munication channels. Shannon showed that feedback cannot 
increase the capacity of the point-to-point discrete memoryless 
channel [1]. For the multiple access (MAC), broadcast and 
relay channels, feedback can potentially increase the capacity, 
but only through a power gain |l2], |I3|. More recently, it has 
been shown in ID that feedback can provide unbounded gain 
in interference channels. In the recent years, there has been 
significant interest in larger networks where communication 
between nodes is established in multiple hops IS], IS), El- 
However, the study of the usefulness of feedback has been 
mostly limited to the above single-hop settings of a few nodes. 

In this paper, we consider general relay networks where 
a source node communicates to a destination node with the 
help of multiple intermediate relay nodes. We are motivated 
by the observation that in wireless, nodes in a network are 
typically capable of both sending and receiving information, 
thus communication links between pairs of nodes are often 
bidirectional. That is, if a given node can send information to 
another node, it can also receive information from that node. 
Therefore, there is inherently a lot of "feedback" in wireless 
networks, though the nature of the feedback is significantly 
different from the idealized feedback models considered in 
single-hop settings. First, transmissions, and therefore also 
feedback, are not isolated in wireless and often subject to 
broadcast and superposition; each receiver observes a mixture 




Fig. 1. Bidirected network with the directed acyclic subnetwork carrying 
approximately its capacity highlighted. 



of the transmitted signals. Second, while in single hop net- 
works the links originating from destinations and/or arriving 
at source nodes can be clearly distinguished as feedback, 
in multihop networks there can be "feedback" between any 
pair nodes. Bidirected links and cycles in the network can 
inherently feedback information, however it is not a priori pos- 
sible to designate links as communication links and feedback. 
Therefore, in these new multi-hop settings it is not totally clear 
how to think about feedback and how to study its usefulness. 

In this paper, we adopt the following approach. We consider 
a general Gaussian relay network with arbitrary topology and 
channel gains, possibly with bidirected links and cycles, where 
some links can be subject to broadcast and superposition and 
some can be isolated in a completely arbitrary fashion. We ask 
the following question: can the information transfer in both 
directions of a link be critical to maximizing the end-to-end 
communication rate in this network? Equivalently, could one 
of the directions in a bidirected link (and more generally at 
least one of the links forming a cycle) be shut down and the 
capacity of the network still be approximately maintained? 

We show that in every wireless network with bidirected 
edges and cycles we can identify a directed acyclic subnetwork 
that approximately preserves the capacity of the original 
network. More precisely, if any of the links that do not belong 
to the identified subgraph could be disabled, the capacity of 
the resultant wireless network would still remain within a 
bounded gap to the capacity of the original network. The 
main technical step is to show that in every Gaussian relay 
network, there exists a directed acyclic subnetwork for which 
the information theoretic cutset upper bound evaluated under 
i.i.d. input distributions is exactly the same as that for the 
original network. See Figure [T] 

Conceptually, this result identifies certain links in the net- 
work as the information carrying links (critical for information 
transfer) and the remaining as feedback (limited contribution 
to capacity). By identifying a directed acyclic subnetwork that 
approximately carries the whole capacity, it allows one to 




Fig. 2. Bidirected network with some of the links removed 

associate a direction with the information flow in an undirected 
wireless network. Understanding which Hnks are critical to 
maintaining the capacity of the network can be also useful 
for reducing the delay and complexity of the communication 
schemes by suggesting which links could be shut down. 
As studied in [81 and ID, cycles significantly increase the 
complexity of (approximately) optimal relaying strategies. 
However, in wireless networks it may not be always possible to 
disable individual links since these links may represent over- 
heard transmissions over other links. Certain networks, such 
as Gaussian networks consisting of only MAC and broadcast 
components as studied by IT] and ifTOl provide some freedom 
in controlling individual links. However, simplification can be 
possible even in more general networks. 

Consider the example in Fig|2}(a) where the edges in the 
graph indicate the wireless links with non-zero channel gains. 
Assume that the backward links from the second layer of 
relays (nodes C and D) to the first (nodes A and B) operate 
over a separate frequency, so that while signals arriving over 
the same colored edges superpose at a node, signals over 
different color edges arrive separately. Similarly, while signals 
over the same colored edges emanating from a single node 
represent broadcast, different signals can be transmitted over 
different colored edges. If the directed acyclic network in 
Figl2}(b) is identified as sufficient for preserving the capacity 
of the network, this implies that the backward channel from 
the second layer to the first need not be used at all. On the 
other hand, if the directed subnetwork is the one in (c), there 
is no operational way to reduce the wireless network in (a) to 
(c). The forward link from node A to D cannot be avoided. 
However, the communication over the backward channel can 
still be simplified by not transmitting from node C and by 
avoiding the received signal at B. 

II. Model 

We consider a bidirected Gaussian relay network G consist- 
ing of a set of nodes V and communication links E. We let 
\V\ denote the total number of nodes. A source node s € y 
wants to communicate to a destination node t eV . All nodes 
in the network are able to send and receive, thus, for each pair 
of nodes u, v G V^ we can potentially have links (u, v) € E 
and {v,u) S E with arbitrary channel gains. We assume the 



links with non-zero channel gains are represented with directed 
edges as in Fig|2l-(a) giving rise to a directed graph with 
potentially bidirected edges and cycles. We assume nodes can 
have multiple transmit and receive antennas. Let Xy G C*''" 
denote the signal transmitted by node v E V with My transmit 
antennas. Similarly, let Yy G C^" denote the signal received 
by node v E V with Ny receive antennas. We have 

Yy = y ^ HyuXu + Zy, 

uev 
where iJ„„ denotes the channel matrix from node u to node v. 
This multiple-input multiple-output channel model can also be 
used to incorporate networks where different channels operate 
on different frequencies such as in Fig|2}(a), as well as isolated 
linkslJ The noise Zy are independent and circularly symmetric 
Gaussian random vectors J\f{0,I). All nodes are subject to 
an average power constraint P. Note that the equal power 
constraint assumption is without loss of generaUty as the 
channel coefficients are arbitrary. 

III. Main Result 

For an arbitrary bidirected Gaussian relay network G with 
a set of nodes V and communication links E, we define a 
directed acyclic subnetwork G to be one which consists of 
the same set of nodes V and a subset of the communication 
links E C E. For the Gaussian relay network, this corresponds 
to setting the channel coefficients corresponding to the edges 
in £■ \ £■ to zero. A directed acyclic subnetwork satisfies the 
property that for any pair of nodes u,v E V, if {u, v) € E 
then {v,u) ^ E. In other words, if there is a link in one 
direction between any two nodes, there cannot be a link in 
the opposite direction. Moreover, it contains no cycles. That 
is, for every set of nodes vi, . . . ,vn G V, at least one of the 
edges {vi,V2),{vk,Vk+i),. ■ ■ ,{vN,vi) E for any value of 
N. 

The main conclusion of this paper is summarized in the 
following theorem. 

Theorem 3.1: In any Gaussian relay network G with ca- 
pacity C{G), we can identify a directed acyclic subnetwork 
G whose capacity C{G) in bits/s/Hz is bounded by 

C(G)-g<G{G) <C{G)+g 

where g = 2 J^^^y Aly + (2 + log 2) J^^^y Ny. 

IV. Background 

In Q, it has been shown that the capacity of any Gaussian 
relay network of the form defined in Section |II] is within a 
bounded gap to the information-theoretic cutset upper bound 
evaluated under i.i.d. Gaussian input distributions. We recall 
the following result from ifTTI : 

Theorem 4.1 (Theorem 2.1, mil): In any Gaussian relay 
network G, we can achieve all rates 



R<imnI{Xs;Ys.\Xs^) 
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(1) 



' Indeed, the conclusions of the paper also hold for wired networks (in this 
case with no gap) and a mixture of wireless and wired networks. 



between s and d, where gi ~ {2 + log 2) J2v<£V ^^" S C V : 
sGS,d^Sisa source-destination cut of the network and 
Xs = {Xy, ?; G 5*} are i.i.d. CA/'(0, {P/M,)I). 

It has been shown in ||6l that the restriction to i.i.d. Gaussian 
input distributions is within 92 = 2^^gyA/t, bits/s/Hz of 
the information-theoretic cut-set upper bound. This shows that 
within this total gap gi +32, the capacity of the network is 
approximately given by 



Ci.i.d.{G) 



mjii/(G', S"), 



(2) 



where 



f{G-S)^I{Xs;YsAXs^), (3) 

and Xy, -y G F are i.i.d. CA/'(0, (P/M„)/). More precisely, 

a. ,d. (G) - 31 < C(G) < C,.,.d. (G) + 52 . (4) 

Let us recall the definition of a submodular function: A 



submodular function / : 2 



V 



-> 



is defined as a function 



over subsets of V with diminishing returns, i.e., V5i, ^2 C V, 

f{Si n ^2) + fiSi u ^2) < f{Si) + J{S2). 

The following theorem is proved in lfT2l . 

Theorem 4.2 (Theorem 1, ^72l/ ).- For any G, /(G; S) : 
2^ — >^ M as defined in Q is a submodular function. 

V. Proof of Main Result 

The proof of the main result of this paper follows by 
combining the fact that the capacity of any Gaussian relay 
network is approximately given by Ci,i.d.{G) in © and the 
following proposition. 

Proposition 5.1: In every bidirected network G with 
Gi.i.d. (G) given in (|2]i, we can identify a directed acyclic 
subnetwork G with Ci,i,d.{G) ~ CiA.dXG)- 

In the rest of this section, we concentrate on proving the 
proposition. We divide our proof into two parts. In the first 
part of the proof, we will show that for any pair of links 
[u, v) and (w, u), we can remove one of the links without 
changing Ci,i,d.. Given this new network, we can iterate this 
procedure for each bidirected link until we are left with a 
directed network that contains no bidirected edges. In the 
second part of the proof we show that given a directed network 
with cycles, we can remove at least one of the links in the 
cycle without changing Ci,i.d.- Iterating this procedure for each 
cycle, we can obtain a directed subnetwork of the same Ci,i.d. 
that contains no cycles. 

We note two important properties of the cut function: 

1) For a fixed cut S C V, the cut values of a network G 
and subnetwork G' are the same if all outgoing links 
from S are in both G and G': 

/(G, S) = /(G', S), if V(u, v) € G : [u € S,v <^ 

S), {u,v) € G' . (Note that because G' is a subgraph of 
G, the channel coefficients corresponding to (m, v) are 
the same in both G and G' if {u,v) G G'.) 

2) /(G, S) is a submodular function on 2^: VS"!, 5*2 C V 
f{G, Si) + f{G, S2) > f{G, 5i U 52) + /(G, 5i n ^2). 
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Fig. 3. Bidirected network witti some of the links removed 

The first property follows from the fact that when all 
outgoing links are in both G and G', the MIMO matrix 
between Xs and Y^ are the same, and thus I{Xs;Y-g\X^) 
which corresponds to the capacity of this MIMO matrix is the 
same for both networks. The second property follows from 
Theorem 14.21 



A. Reduction of bidirected network to directed network 

Given a bidirected network G and any pair of links (w, v) 
and {v, u), we create the subnetworks G', G", and G'", where 
the link {v, u), {u, v), and both {u, v) and {v, u) are removed 
from G, respectively. See Figure |3] 

Define Sy, Su, Suv, Suv, to be the following: 

Sy ~ arg min f{G,S) 

{S:s,vGS t,u^S} 

Su = arg min /(G, S) 

{S:s,uGS t,v^S} 

Suy = arg min /(G, S) 

{S:s,u,veS ti^S} 

Suw= arg min f{G,S). 

{S:s<£S t,u,v<^S} 

Sy is the cut with the minimum cut value among all cuts 
for which v remains on the source side and u remains on 
the destination side; Su is the cut with the minimum cut 
value among all cuts for which u remains on the source side 
and V remains on the destination side; S^y is the cut with 
the minimum cut value among all cuts for which both u 
and V are on the source side; and 5^ is the cut with the 
minimum cut value among all cuts for which u and v remain 
on the destination side. See Figure |4] A cut that achieves the 
minimum cut value need not be unique; we choose an arbitrary 
one in such cases. Note that 

G,,..d.(G) = min (/(G, 5„), /(G, Su),f{G, Syy), f{G, Suw)) ■ 

(5) 
We also define S'y, S'^, S'^y, SL-, and S'^, S'^, S'^y, S^ in a 
similar fashion for graphs G' and G", respectively. 

Proposition 15. II claims that either Ci,i,d,{G) — Gi,i,d.{G') 
or Ci,i,d.{G) = Ci,i,d.{G"). We prove this by showing that 
each of the following assumptions lead to a contradiction: 

(a) G,.,.d.(G) < G,.,.d.(G') and G,.,.d.(G) < G,.,.d.(G"); 







Fig. 4. Example of Sv, Su, Suv, S^i^ 

(b) a.^.dXG) < a..d.{G') and a.,.d.{G) > a.,.d.{G") (or 
equivalently, Ci.^.dXG) > C^.^.d.{G') and C^.^.d.{G) < 

(c) Cild.iG) >a.,.d.{G') and C\.,.d.{G) > G,.,.d.{G")- 

Case (a): Assume Ca d (G) < Ca d {G') and 
G^.^.dXG) < C^.^.diG"). If C,.,.d.(G) < C,.,.d.(G'), then 



Ci.i.d.{G) = f{G,Sv), 



and 



/(G, 5„) < min (/(G, 5„), /(G, 5„.„), /(G, 5^)) • (6) 

This can be seen as follows. Note that the minimums in the 
definitions of Su , Suv and 5^7 are taken over a set of cuts that 
cannot cross the link {v,u) and G and G' only differ by the 
existence of the link {v, u). By Property (1), any cut that does 
not cross the edge {v, u) has the same value in G and G'. 
Therefore, /(G,5„) = f{G',Su), /(G,5™) = /(G',5„,„) 
and /(G, Suv) = /(G', 5*1^7) ■ Now, if the minimum in Q were 
to be achieved by any term other than /(G, Sv), this would 
imply that Ci,i.d.{G') < Gi,i,d.{G), which would contradict 
the assumption that Ci,i.d.{G) < Ci,i.d.{G'). Therefore, we 
have (|6]l. 

Now, if also Ci,i,d.{G) < Gi,i.d.{G"), by the same argument 
above we should have 



Gi.i.d.{G) — f{G,Su), 



and 



/(G, Su) < min (/(G, Sv), f{G, Suv),f{G, Suv)) ■ (7) 
But ^ and (|7]i are contradictory. 

Case (b): Assume Ci,i.d.{G) < Gi,i.d.{G') and 
Gi.i.d.{G) > Gi,i.d.{G"). Then, by the same argument in case 
(a), we have 

Gi.i.d.{G) — f{G,Sv), 

f{G, Sv) < min (/(G, Su), f{G, Suv),f{G, Suv)) ■ (8) 
Similarly, the assumption Ci,i.d.{G) > Gi,i.d.{G") implies that 

Q...,.(G") = /(G",5::), 



and 

/(G", S'l) < min (/(G", S':), f{G", S'^JiG", S^)) . 

(9) 
This follows by the same argument for (|6]i: Since G and G" 
only differ by the existence of (u, v), the value of the cut 
Su should be different in G and G" while the values of the 
remaining three cuts are the same in both G and G". 

Note that ^ implies that 

/(G, Sv) < f{G, Suv) < /(G, Sv n s':), 

where the last inequality follows from the fact that since 
u ^ Sv and V ^ S'u, u,v i SvH S". Now, by Property (1), 
/(G, Sv) = f{G", Sv) and /(G, Sv n S'^) = /(G", Sv n S'^) 
since G and G" only differ by the existence of the link {u, v) 
and both Sv and 5„ n S*" correspond to cuts that cannot cross 
this link. Therefore, we have 

fiG",Sv)<f{G",Svns':). 

On the other hand, (|9]l implies that 

/(G", S^) < f{G", S':,,) < f{G", Sv U S^), 

since v £ Sv and it G 5", u, w £ S'u U S*". Combining the last 
two inequalities we obtain 

/(G", Sv) + f{G", S:) < f{G", Sv n 5;') + f{G", Sv U S':,). 

However, submodularity (Property (2)) for / implies that 

/(G", Sv) + f{G", S':) > f{G", Sv n S':,) + /(G", Sv U S;,'), 

which leads to a contradiction. 

Case (c): Finally, we assume Ci,i,d.{G) > Ci,i.d.{G') 
and Gi,i.d.{G) > Gi,i.d.{G"). By similar arguments as in case 
(b), the first assumption implies that Gi,i.d.{G') = f{G' ,S'^), 
and the second one implies that Gi,t,d.iG") = f{G",S'^). 
Moreover, 



and 



fiG',S',)<fiG,S'uUS';), 



f{G",S':)<f{G,S[,nS:). 



(10) 



(11) 



The last two inequalities follow from our assumption, 
G,...d.(G) > Ci.,.d.{G') and C,.,.d.{G) > G,.,.d.(G"), which 
implies that the minimum cut values for G' and G" are strictly 
less than any cut value of G. Combining ( fTOl i and ( fTTT i. we 
have 

/(G', 5,:,) + /(G", s;') < /(G, S'u n s::) + /(g, s', u s^), 

Observing that by Property (1) 

/(G',5:,)-/(G"',S;,) (12) 

f{G",s':) = f{G'",s:) (13) 

/(G,s;n5;') = /(G"',s;,ns:,') (14) 

/(G,s;u5:) = /(G"',s;us::), ns) 



we get 

f{G"\S',) + f{G"',S:) < f{G"\S',nS':) + f{G"\S',US':). 

This contradicts with the submodularity of / in G'" . 

Since we have ehminated cases (a), (b) and (c) above, we 
conclude that either Ci,i.d.{G) = Ci,i.d.{G') or Ci,i.d.{G) = 
Ci.i.d.iG )• 

B. Removing cycles in a directed network 

Consider a directed network G, where the nodes 
{wi, W2, ■ ■ -vn} form a length N cycle, and let vn+i = vi- 
Define Gk, k ~ 1, 2, . . . , A^ to be a subnetwork of G with the 
link {vk, Vk+i) removed. In our proof, we denote subnetworks 
with both links {vk~i,Vk) and {vk,Vk+i) removed as Gk-iM- 
See Figure (|5]l for an example. Let S* and Sk denote cuts 
that achieve the minimum cut values of networks G and Gk, 
respectively: 

S* = arg mill f{G,S), 
{S:ses t^s} 

Sk ^ arg min f{Gk,S). 

{S:ses t^s} 



1 i SI 
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Fig. 5. An example of a directed network with a length 3 cycle and 
subnetworks with some links removed. 

We prove that Ci,i.d. (G) = Gi,i,d. (Gk) for at least one value 
of k, k = 1, 2, . . . , A^ by showing that each of the following 
assumptions lead to a contradiction: 

(a) Q.,.rf.(G) > Cu.dXGk) for fc = 1, 2, . . . , iV; 

(b) Gi i d (G) < Gii d {Gk ) for at least one value of k, 
Gi.i.d.(G) 7^ C,,i,d.{Gk) for fc = 1, 2, . . . , iV. 

Case (a): Assume Ci,i.d.{G) > Gi,i,d.{Gk) for k = 
1,2,...,A^. Given our assumption, we first show that for 
each subnetwork Gk 
minimum cut value, i.e 



there exists a cut 5[. that achieves the 



with the property wi , W2 , . . . , Wfe £ S'^. and Vk^ 
will lead to a contradiction when we take k ~ N . 

If C^.^.d.{G) > G.,,,.d.{Gk), then Vk G Sk and Vk+i £ 5^. 
This can be seen as follows. Any cut that does not cross the 
link {vk, Vk+i) has the same cut value for both G and Gk by 
Property (1). So the minimum cut value attained by Gk must 
be for a cut which crosses the link {vk,Vk+i) and yields a cut 
value strictly less than any cut which does not cross that link. 
Thus, for fc = 1 we can choose 5( =5*1. 

We will discover the sets 5^ for larger k by induction. We 
will show that if the claim in ( fTSI ) holds for fc — 1, it should 
also hold for fc. 

First note that since Sl_^ and Sk achieve the minimum cut 
values for Gk-i and Gk, they must be less than or equal to 
any other cut in Gk-i and Gk respectively. In particular. 



f{Gk-i,Sl_i) < f{Gk-i,S'i,_i n Sk), 
fiGk,Sk)<fiGk,Sl_^USk). 



(17) 
(18) 



Now, since Vk G 5[._i and Vk € S'f._^ n Sk, (wfe, Ufc+i) cannot 
be an outgoing link in either of the cuts Sl_^ and 5^_j^ fl S'fc, 
and all other links in Gk-i are also in Gk-i.k, so by Property 
(1) of /, we have 



f{Gk-i,k,S'k^i) 

f{Gk-i,k,sl_i n Sk) 



f{Gk-i,Sl_,), (19) 

f{Gk-i,Sl_^nSk). (20) 



Also, Vk G Sk and Vk G >5'^_i U Sk, so {vk-i,Vk) cannot be 
an outgoing link in either of those cuts, and all other links 
in Gk are also in Gk-i,k- So again by Property (1) of /, we 
have 

fiGk-i.k,Sk)^f{Gk,Sk), (21) 

f{Gk-i,k,S',_, U Sk) - /(Gfe, S',_, U Sk). (22) 

By the submodular property of / on Gk-i^k and equations 
((S-dlSi, we have: 

f{Gk-i,S'i,_,)^f{Gk,Sk)> 
/(G,_i, 5;^„i n Sk) + f{Gk, S',_, U Sk). 

Combining this result and equations ( fTTT i and (fTST l yields 

f{Gk,Sk)^.f{Gk,S',_,DSk). 

Thus the cut S^. = S'f._i U Sk achieves the minimum cut 
value for network Gk and has the property vi, . . . ,Vk G S*^. 
Now suppose I'k+i G S'l^. Then the cut S'/. cannot cross the 
link {vk, Vk+i), and thus f{Gk, S*^) = /(G, 5[,). But since S'^ 
achieves the minimum cut value for network Gk, we have the 
following: 



Gi.i.d.{Gk) — f{Gk,S'f,) 



Gi.i.d{Gk) — !{Gk,Sj.) 
= fiG,S',) 
> Ci.i.d{G), 

which would contradict our assumption. The last inequality 
follows because Gi,i.d{G) must be less than or equal to any cut 
(16) value of G. Thus, Vk+i ^ 5^. Letting k ^ N, G,.,.d.(Gjv) = 



/(Gjv, S'pf). The link {vn, vi) is not an outgoing link in S'j^, 
and all other links in Gat are also in G, so by Property (1) of 

Ci.i.d.i^N) ~ /(GatjSjv) = f{G,Sj^) > Ci,i,d.{G), 
which contradicts our assumption. 

Case (b): Assume Ci,i.d.{G) < Gi,i.d.{Gk) for at least 
one value of fc, G,,,d.(G) ^ G,,,d.(Gfc) for fc = 1, 2, . . . , A^. 

Without loss of generality, let Ci,i,d.{G) < Ci,i,d.{Gi). By 
the same arguments as in the previous case, vi G S**, U2 £ S*. 

We now show that for fc > 1, if Ufc e S"*, then Vk+i G S*. 
This will lead to a contradiction when we take k = N. 

Assume Vk G S* and consider Ci,i.d{Gk)'- 

C^.^.d{G)^f{G,S*) 
= /(Gfe,5*) 

> Ci,i.d{Gk)- 

(a) follows by Property (1) and the fact that Vk € S*, and so 
S* cannot cross the link (vk, Wfc+i). (b) follows from the fact 
that Ci,i.d{Gk) must be less than or equal to any cut value 
of Gk and our assumption that Gi,i,d{G) ^ Gi,i,d{Gk) for 
fc = 1, 2, . . . , A^, thus making the inequality strict. Now since 
Gi.i.d{Gk) < Gi,i,d{G), for the minimum cut Sk, we must 
have Vk G Sk, Vk+i G Sk- Next, consider S* fl Sk- We have 

/(Gfc, s* n Sk) = f{G, S* n Sk) (23) 

> f{Gk,Sk), (24) 

where (a) follows by Property (1) and the fact that Vk G 
S* (1 Sk, and so S* fl Sk cannot cross the link {vk,Vk+i)- 

(b) follows because Gi.i.d{Gk) < Gi.i.d{G), so the minimum 
cut value of Gi,i.d{Gk) = f{Gk, Sk), must be strictly less than 
any cut value of G. Now suppose Vk+i G 5*. Then 



fiGk,S*USk)^^ fiG,S*USk) 
>f{G,S*) 



(c) 



f{Gk,S*). 



(25) 

(26) 
(27) 



(a) and (c) follow because Vk+i G S* USk and Vk+i G S*, so 
neither of those cuts can cross the link {vk, Wfc+i). (b) follows 
because S* achieves the minimum cut value of graph G. 
Combining (|23]|-(|27]|. we have 

f{Gk, S* U Sk) + /(Gfe, 5* n Sk) > f{Gk, Sk) + /(Gfe, 5*). 

This contradicts the submodularity of f in Gk- Thus Vk+i G 
S^. _ 

Letting k = N, we have vi G S* ,V2,v^, . - . ,vn G S*- 
However, because vi, . - . ,vn form a cycle, the node vi can be 
thought of vn+1 and vn S S* by the above iteration implies 
that vi G S*- This contradicts with the fact that vi G S* and 
shows that the initial assumptions for case (b) necessarily lead 
to a contradiction. 



Since we have eliminiated cases (a) and (b) above, we 
conclude that Gi,i.d{G) = Gi,i,d{Gk) for at least one value 
oik = l,2,-.-,N. 
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